Geometrical Expression of Excess Entropy Production 
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We derive a geometrical expression of the excess entropy production for quasi-static transitions 
between nonequilibrium steady states of Markovian jump processes, wiiich can be exactly applied 
to nonlinear and nonequilibrium situations. The obtained expression is geometrical; the excess 
entropy production depends only on a trajectory in the parameter space, analogous to the Berry 
phase in quantum mechanics. Our results imply that vector potentials are needed to construct the 
thermodynamics of nonequilibrium steady states. 
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I. INTRODUCTION 

Investigating thermodynamic structures of nonequilib- 
rium steady states (NESSs) has been a topic of active re- 
searches in nonequilibrium statistical mechanics [J-Q: 
[TtI . IsTj . For example, the extension of the relations in 
equilibrium thermodynamics, such as the Clausius equal- 
ity, to NESSs is a great challenge [H-ItI. Isij . The extended 
thermodynamics, which is called steady state thermody- 
namics (SST) |2j, is expected to be useful to analyze and 
to predict the dynamical properties of NESSs. However, 
the complete picture of SST has not been understood. 

In equilibrium thermodynamics, the Clausius equality 
tells us how one can determine thermodynamic potential 
(entropy) by measuring the heat: 



(1) 



which is universally valid for quasi-static transitions be- 
tween equilibrium states. Here, v is an index of the heat 
baths, /?" is the inverse temperature of bath v, Q'^ is 
the heat that the system absorbed from bath v, and 
S is the Shannon entropy of the system. The second 
term of the left-hand side (LHS) of ^ is called the en- 
tropy production in the baths. To generalize the Clau- 
sius equality to nonequilibrium situations, it has been 
proposed that heat needs to be replaced by ex- 
cess heat Qpxj which describes an additional heat induced 
by a transition between NESSs with time-dependent 
external control parameters such as the electric field. 
Correspondingly, the total heat can be decomposed as 
Q" — Qcx + Ohk' where housekeeping heat Qj^j^ describes 
the steady heat current in a NESS without any param- 
eter change. Quantitative definitions of these quantities 
will be given later. One may then expect that there exists 
some thermodynamic potential S'sst which characterizes 
NESSs such that 



A^ssT-5]rQe". = 0, 



(2) 



holds for quasi-static transitions between NESSs, where 
the second term of the LHS corresponds to the excess 



part of the entropy production in the baths. Komatsu, 
Nakagawa, Sasa, and Tasaki (KNST) found that S'sst in 
Eq. ([2]) is a symmetrized version of the Shannon entropy 
in the lowest order of nonequilibriumness j^jQ- However, 
the full order expression of the extended Clausius equal- 
ity ^ has been elusive. Then, some fundamental ques- 
tions arise: What is the nonequilibrium thermodynamic 
potential S'sst in Eq. ^ in the full order expression? 
Does there exist such a potential at all? 

In this paper, we answer these questions, and derive a 
full order expression of the excess entropy production for 
Markovian jump processes. We note that driven lattice 
gases are special cases of our formulation. We have found 
that an extended Clausius equality in the form of ^ does 
not hold in general; scalar thermodynamic potential Ssst 
should be replaced by a vector potential. In other words, 
the first term of the LHS of should be replaced by 
a geometrical quantity that depends only on trajectories 
in the parameter space. Our result includes equilibrium 
Clausius equality ([U and the KNST's extended Clausius 
equality as special cases. We will also derive the general 
condition that there exists a thermodynamic potential 
Ssst such that Eq. ^ holds. 

We have used the technique of the full counting statis- 
tics [ll|, [13 to prove our main results. In the context of 
the full counting statistics (and also stochastic ratchets), 
it has been reported |19l - [26| that several phenomena in 
classical stochastic processes are analogous to the Berry's 
geometrical phase in quantum mechanics [13, [l^. In 
this analogy, the above-mentioned vector potential cor- 
responds to the gauge field that induces the Berry phase. 
Our result can also be regarded as a generalization of 
these previous studies on the classical Berry phase. 

This paper is organized as follows. In Sec. II, we for- 
mulate the model of our system and define the decom- 
position of the entropy production into the housekeeping 
and excess parts based on the full counting statistics. In 
Sec. HI, we derive our main results, which consist of the 
geometrical expressions of the excess parts of the cumu- 
lant generating function and the average of the entropy 
production. In Sec. IV, we apply our main results to two 
special cases; one is equilibrium thermodynamics with 



2 



the detailed balance, and the other is the KNST's ex- 
tended Clausius equality. In Sec. V, we discuss a quan- 
tum dot as a simple example, where Eq. ^ does not hold 
in general. In Sec. VI, we conclude this paper with some 
discussions. 



II. SETUP 

We first formulate our setup and define the decompo- 
sition of the cumulant generating function of the entropy 
production into the excess and housekeeping parts. 

A. Dynamics 

We consider Markovian jump processes with N < 
oo microscopic states. Let Px be the probability that 
the system is in state x. The probability distribution 
of the system is then characterized by vector \p) :— 
[Pi,P2r-' iPn]'^, where 1,2,-- - ,7V describe the states, 
and "T" describes the transpose of the vector. The time 
evolution of the probability distribution is given by a 
master equation \p{t)) = R{a{t))\p{t)) , where \p{t)) de- 
scribes the time derivative of \p{t)), R{a.) is a N x N 
matrix characterizing the transition rate of the dynam- 
ics with external parameters a. Here, the external pa- 
rameters correspond to, for example, a potential or a 
nonconservative force applied to a lattice gas, or the 
temperatures of the heat baths. We drive the system 
by changing a. For simplicity of notations, we will of- 
ten omit "(a(i))" or "(i)" in the following discussions. 
We note that J2x ^ *-* holds for every y, where Rxy 
is the xy-component of R that characterizes the transi- 
tion rate from state y to x. We assume that R is irre- 
ducible such that R has eigenvalue without degeneracy 
due to the Perron- Frobenius theorem. We write as (1| 
and \p^) the left and right eigenvectors of R correspond- 
ing to eigenvalue such that = and R\p^) = 
hold. We note that (1| = - ,1] holds and that 
\p^) = [pfjpfr'' ^V%Y is the unique steady distribu- 
tion of the dynamics with a given a. For simplicity, 
we assume that R is diagonalizable. We also assume 
that the transition matrix can be decomposed into the 
contributions from multiple heat baths, labeled by as 

We next introduce the entropy production that de- 
pends on trajectories of the system. Such a trajectory- 
dependent entropy production has been studied in terms 
of nonequilibrium thermodynamics of stochastic sys- 
tems [l^ l29l - [3]| . The entropy production in bath v with 
transition from y to a; is given by 

= / 1" 5| = (if + and i?^, ^ 0), 

\ (i/i^^j^ = and i?^;^ ^ 0), 

where Q^^^ is the heat that is absorbed in the system from 
bath V during the transition from y to x. Equality (jS]) is 



consistent with the detailed fluctuation theorem [l^. Hi- 
. The integrated entropy production from time to r 
is determined by the trajectory of system's states during 
the time interval as 

= X! '^x(t-i-o)a(t-o)' (4) 

t\ jump 

where the sum is taken over all times at which the system 
jumps, and y(t — 0) and x{t -t- 0) are the states immedi- 
ately before and after the jump at t, respectively. We 
note that the ensemble average of u is equivalent to the 
entropy production in the conventional thermodynam- 
ics of macroscopic systems. A reason why we consider 
the trajectory-dependent entropy production lies in the 
fact that the entropy production is connected to the heat 
through Eq. at the level of each trajectories. 



B. Full Counting Statistics 

We then discuss the full counting statistics of a. Let 
P(g) be the probability of a. Its cumulant generating 
function is given by 

S{ix):=\nJ dae'^^P{a), (5) 

where x £ is the counting field. S{ix) leads to the 
cumulants of a like {a) — dS{ix) / d{ix)\x=Qi where (• • • } 
describes the statistical average. To calculate S{ix), we 
define matrix R^ as {Rx)xy '■= J2u ^xy^'^Pi^X'^xy)^ ^^'^ 
consider the time evolution of vector \pxit)) correspond- 
ing to 

|Px(i))=i?x(a(<))K(t)) (6) 

with initial condition \px{0)) '■= |p(0))- The for- 
mal solution of Eq. ^ is given by \Px{t)) = 
Texp^ {^Jq Rx{a{t))dt) \p{0)), where Texp^ describes 
the left-time-ordered exponential. Then we can show 
that 

e^('>^) = (lK(r)) (7) 

holds, where (-j-) means the inner product of left and 
right vectors. 

We write the eigenvalues of i?^ as A^'s, where n = 
corresponds to the eigenvalue with the maximum real 
part. If Ixl is sufficiently small, A° is not degenerated 
and Rx is diagonalizable. We write as (A^| and |Ap the 
left and right eigenvectors corresponding to A", which 
we can normalize as (A^|A™) = 5nm with Snm being the 
Kronecker's delta. In particular, we write (A°| =: 
and |A°) -. \p^). We note that, if x 0, (1^1 and |p^) 
reduce to (1| and \p^), respectively. 
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C. Decomposition of the Entropy Production 

It is known that \'^{cx.) is the cumulant generating 
function of a in the steady distribution with parameter 
a. More precisely, A°(a) satisfies 



A°(q;)= hm 



5'(ix;a;r) 



(8) 



where S{ix', cy.,T) is the cumulant generating function of 
a from to r with a being fixed. 

We then decompose the cumulant generating function 
into two parts: 

S{ix) = Sh]^{ix) + ScAix), (9) 
where S'hk(*x) is the house- keeping part defined as 



^hk(*x) := / AO(a(t))dt, 



(10) 



and S'cx(*x) is the excess part defined as S'ex(*x) ■= 
S{ix.) ~ Shki^x)- The average of the excess entropy pro- 
duction is given by 



d{ix) 



(11) 



We note that the above decomposition is consistent 
with that in Refs. In fact, from Eqs. © and (HH), 

we can show 



(cr)cx = (o-) 



hk:a(t) 



dt. 



(12) 



where (a')hk;a '■— i9A^(a)/9(ix)lx=o is the long-time av- 
erage of the entropy production per unit time with a 
being fixed. 



III. MAIN RESULTS 



We now discuss the main results of this paper, which 
we will refer to as Eqs. ([T5|) and P7|) . First of all, we 
expand ^s 

|p^(t))=^c„(t)e^"W|A'^(«(t))), (13) 



where A^(i) := y^{a.{t'))dt' . We can show that cq ^ 
-E„c„(lJA^)e^x-A° and (IJA^) = (1 J7?JA^)/(A^ - 
A°) hold. Therefore, if the speed of the change of the 
external parameters is much smaller than the relaxation 
speed of the system, we obtain 



co(i) 



-co(t)(l^(a(t))|p^(a(t))). 



(14) 



Here, we have used that the real part of — A^ is neg- 
ative for all n ^ 0. We note that this result is similar 



(but not equivalent) to the adiabatic theorem in quantum 
mechanics. 

Assume that we quasi-statically change parameter ol 
between time and r along a curve C in the parameter 
space. The solution of Eq. (IT4|) is given by 



co(t) = co(0)e-/cr'i*<ix(«W)lp^(«(*))> 
= co(0)e-^c(ixldbf>^ 



(15) 



where "d" on the right-hand side (RHS) means the to- 
tal differential in terms of ol such that d\p^) := da ■ 
T^lp:^). Let the initial distribution be the steady dis- 
tribution |p(0)) = \p^{a.{Q))), which leads to co(0) = 
{\^{ol{Q))\p^ {a.{{)))) . Wc then obtain the excess part of 
the cumulant generating function as 



su^x) = / (ixMbx) 

Jc 

+ ln(l^(a(0))|p^(a(0))) + ln(lbf (^(t))), 

(16) 

where the RHS is geometrical and analogous to the Berry 
phase in quantum mechanics [27']; it only depends on 
trajectory C in the parameter space. More precisely, 
the RHS of Uni) is analogous to the non-cyclic Berry 
phase ^261, "28] . We note that A^ (t) is analogous to the 
dynamical phase. In this analogy, and respec- 
tively correspond to a state vector and a Hamiltonian. 
Equality ()16p is our first main result. 



In terminologies of the Berry phase, (l^|d|p^) corre- 
sponds to a vector potential or a gauge field whose base 
space is the parameter space. The second and the third 
terms of the RHS of ((H]) confirms the gauge invariance of 
S'ox(ix) 3'S is the case for quantum mechanics [1^, where 
the gauge transformation corresponds to the transfor- 
mation of the left and right eigenvectors of ^s 
(Ix(a)l (lx(a)|e-^(°) and ^^(q;)) ^ e^(°)|p'5(a)) 
with 9{a.) being a scalar. We note that several formu- 
lae that are similar to Eg. ([T51) have been obtained for 



different setups [l^-il, [111^?^ 

By differentiating Eq. p6p in terms of ix, we obtain 
a simple expression of the average of the excess entropy 
production: 



(I'MI/) 



= 0, 



(17) 



where (l'| := d{l^\/ d{ix)\x=Q- Equality p?|) is the sec- 
ond main result, which is the full order expression of the 
average of the excess entropy production. On the con- 
trary to Eq. dl]), the first term of the LHS of ^ is not 
given by the difference of a scalar potential S'sst, but by 
a geometrical quantity. We also refer to (l'|(i|p'^) as a 
vector potential. 

We can explicitly calculate (l'|. By differentiate the 



both-hand sides of (l^l^x 



X'^Rx in terms of ix, we 



have (I'l = -(l|9i?x/'9(zx)lx=o-R^ + fc(l|, where i?t is the 
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Moore-Penrose pseudo-inverse of R and k is an unimpor- 
tant constant. Therefore, we obtain 



E 



(18) 



Some similar formulae for particle currents have been ob- 
tained in Refs. ^19.. ,23,] . 

We next consider the condition for the existence of 
thermodynamic potential S'sst that satisfies Eq. ([2])- For 
simplicity, we assume that the parameter space is simply- 
connected, i.e., there is no "hole" or singularity. The nec- 
essary and sufhcient condition for the existence of S'sst 
is that the integral in the first term of the LHS of p7)) 
is always determined only by the initial and final points 
of C; or equivalently, f^{l'\d\p^) = holds for every 
closed curve C. On the other hand, the Stokes theorem 
states that §c{l'\d\p^) = Jgd{{l'\d\p^)) holds, where S 
is a surface whose boundary is C, and "d" means the 
exterior derivative. By using the wedge product "A," 
we have d {{l'\d\p^)) ^ d{l'\ A d\p^) := Y.x A dp^ ^ 

'^xki S^^^'^'^'^' A*^*^'' "^liere 1^ means the a;-component 
of vector (l'|, and ak is the /c-component of a. Therefore 
the necessary and sufficient condition is that 



d(l'| Ad|/) =0 

holds in every point of the parameter space, 
tion is equivalent to 



E 



ai; 9pf 91^ dpi 



dak dai dai dai 







(19) 
Equa- 



(20) 



for all {k,l). In terminology of the gauge theory, d{l'\ A 
d\p^) corresponds to the strength of the gauge field or 
the curvature. For the case of the L/(l)-gauge theory, the 
curvature is the magnetic field. 

In equilibrium thermodynamics, Eq. (|19p holds due to 
the Maxwell relation, and {l'\d\p^) becomes the total dif- 
ferential of the Shannon entropy as we will see in the next 
section. On the other hand, Eq. does not hold for 
transitions between NESSs in general. In this sense, vec- 
tor potential {l'\d\p^) plays a fundamental role instead 
of the scalar thermodynamic potential (i.e., the Shannon 
entropy) in SST. 



IV. SPECIAL CASES 

In this section, we discuss two special cases, in which 
the first term of the LHS of pTt reduces to the total 
differential of a scalar thermodynamic potential. 



A. Equilibrium Thermodynamics 



balance is satisfied. Let be the energy of state x. 
The transition rate is given by i?; 



■xy 



-w'-y) with 



Wxy = Wyx, the steady distribution by p^ - 
with Z being the partition function, and the entropy pro- 
duction in a bath by axy — ~-(3{Ex — Ey) — —PQ^y. In 
the quasi-static limit, the system is in contact with a sin- 
gle heat bath with inverse temperature /3 at each time, 
while j3 can be time-dependent. We then obtain 



{l'\d\p^) =Y,PE^dpl ^ di-Y^p^lnpl 

X \ X 



(21) 



which means that {V\d\p^) is the total differential of the 
Shannon entropy. 



B. KNST's Extended Clausius Equality 

We now show that Eq. (IT7| reduces to the KNST's 
extended Clausius equality [J, [1| in the lowest order 
of nonequilibriumness. Here we assume that, for every 
(x, ?/), there exists at most single v that satisfies R'^y ^ 0, 
so that we can remove index v. This is the same assump- 
tion as in Refs. [1, [I]- Moreover, we formally introduce 
the time-reversal of states; the time-reversal of state x, 
denoted as x* , is assigned in the phase space. Since 
we are considering stochastic jump processes that do 
not have any momentum term usually, we just interpret 
the correspondence formal mathematical 

map. Correspondingly, we should replace \a{R^y/Ry^) in 
Eq. (O by ln(i?^j,/i?^.^.). Only with this replacement, 
all of the foregoing arguments remain unchanged in the 
presence of the time- reversal. We also assume that, in 
thermal equilibrium, — p^, holds. We define 



ry ■.^Y.^n{pl,/pl,)RxyRlJpl 



E 



■lnpf.)dpf (22) 



and Rxy ■— Ryx'Px* /Py" Here, R is the adjoint of R 
for the cases oi x ^ x* [1, [HI- We note that R^y = 
holds for every y. Since R = R holds if the detailed bal- 
ance is satisfied, we characterize the nonequilibriumness 
of the dynamics by e :— max^jj, \{Rxy — Rxy) / Rxy\- We 
then obtain 

(l'|d|/) + 77 ^Y.^n{Rxy/Rxy)RxyRlM 

xyz 

^Y.{Rxy-Rxy)R^yM + 0{e^A) (23) 



xyz 

= 0{e^A), 

where A := max^, \dp^\ characterizes the amount of the 
infinitesimal change of the steady distribution. On the 
other hand. 



In general, we can explicitly show that Eq. PT)) re- 
duces to the equilibrium Clausius equality if the detailed 



E^^ 



Px In 



PxPx- 



(24) 
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holds f5|. From Eqs. ([231) and (HH), we obtain 



We can explicitly calculate the vector potential as 



1 



+ 0(6^ A), (25) 



which implies the KNST's extended Clausius equality, 
where the first term of the RHS is the total differential 
of the symmetrized Shannon entropy. We note that, if 
we gradually change parameter ot from an equilibrium 
distribution, then the KNST's extended Clausius equal- 
ity is valid up to the order of 0(£^) because A = 0(e) 
holds. 



V. EXAMPLE 

As a simple example that illustrates the absence of a 
scalar thermodynamic potential, we consider a stochas- 
tic model of a quantum dot that is in contact with two 
baths that are labeled hy v = L and R (see also Fig. 1 
(a)) [18]. This model describes the stochastic dynamics 
of the number of electrons in the dot by a classical master 
equation. 

An electron is transfered from the baths to the dot 
one by one or vise-versa. We assume that the states of 
the dot are x = and 1, which respectively describe 
that the electron is absent and occupies the dot. The 
probability distribution is described by \p) — [pqtPiY' , 
and the transition rate is given by i? = J2v=l r with 



(l'|d|p^) = --{cTL+ai,){fL{l-fL)daL+fR{l-fB)dau), 

(27) 

and the curvature as 



d(l'|Ad|/ 



4(/l(1-/l) 



-fR{l-fB))d<JLhdaR. (28) 



Therefore, the curvature vanishes only if /i^ = ^lr or 
2E ~ HL + fJ'R holds. The former case corresponds to 
equilibrium thermodynamics. Since the curvature van- 
ishes only on the two lines in the two-dimensional pa- 
rameter space, any scalar potential cannot be defined on 
the entire parameter space. We note that the quantities 
that we have calculated here are different from those in 
the previous researches [20l - [2^ . [2^ . [25| . 

As a simple illustration, we consider the following sit- 
uation. The dot is initially in thermal equilibrium with 
ctl = ctr = 0. We then quasi-statically change ctl 
from to u, while an is not changed. We calculate 
(ct)cx = /o"crL/L(l-/L)dcrL/4 for this process. For com- 
parison, we also calculate the difference of the Shannon 
entropy between the initial and final distributions of the 
dot, denoted as AS'. Figure 1 (b) shows {a)ex (the sohd 
line) and —AS (the dashed line) versus u. They are coin- 
cident with each other up to the order of O(u^), which is 
consistent with the extended Clausius equality discussed 
in Sec. IV. B with u = 0(e) = 0(A). 



(26) 



where 7^ is the tunneling rate between the dot and bath 
V, and /i, = (e'^f^^''") + 1)^^ is the Fermi distribu- 
tion function with /3 being the inverse temperature of 
the baths, being the chemical potential of bath v, 
and E being the excitation energy of the dot. The 
entropy production is given by CTqq = ali — and 
= —ctqi = (Ji, with Ui, := /3(/i,y — E). For simplic- 
ity, we set 7l = 7_R =: 7. Without loss of generality, we 
assume that the control parameters are ctl and gr. 



(b) 0,5 



o 




FIG. 1: (a) A schematic of the model of a quantum dot. A 
single electron is transfered to/from the two heat baths with 
chemical potentials /xz, and /xh. (b) {a")ex (the solid line) 
and —AS (the dashed line) for quasi-static processes. They 
are coincident with each other up to the second order of the 
nonequilibriumness of the final state that is denoted by u. 



VI. CONCLUSIONS AND DISCUSSIONS 

We have derived the geometrical expressions of the ex- 
cess entropy production for quasi-static transitions be- 
tween NESSs: Eq. ^ for S'cx(ix) and Eq. ^ for (cr)cx- 
Our results imply that the vector potentials 
and (l'|(i|p'^) play important roles in SST. We have also 
derived condition (jl9p that a scalar thermodynamic po- 
tential exists. 

We note that the arguments in Sees. II and III are 
not restricted to the case of entropy production cr^^, but 
can be formally applied to an arbitrary quantity f^y that 
satisfies j^^ = 0. In fact, even if we replace ct^^ by any 
f^y, the formal expressions of the main results in Sec. Ill 
remain unchanged. However, we have explicitly used the 
properties of fi^y such as Eq. ^ in Sec. IV. 

We also note that, as is the case for the gauge the- 
ory, we can rephrase our results (jl5p and (jl6p in terms 
of differential geometry [s^]. We consider a trivial vec- 
tor bundle whose base manifold is parameter space {ol\. 
The fiber is C, and c^it) in Eq. (|13p is an element of the 
fiber. Then (l^|d|p:^) is a connection form, and Eq. (fH)) 
describes the parallel displacement of cq with the connec- 
tion along curve C 

In this paper, we have assumed that nonequilibrium 
dynamics is modeled by a Markovian jump process with 
transition rate R being diagonalizable. To generalize our 
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results to other models of nonequilibrium dynamics is 
a future issue. For example, it is worth investigating 
whether our result can be generalized to Langevin sys- 
tems. Moreover, to investigate the usefulness of our re- 
sults in nonequilibrium thermodynamics is also a future 
challenge. 
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